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Abstract 

Background: Claims data are potentially useful for identifying long-acting p-agonist (LABA) use by patients with 
asthma, a practice that is associated with increased mortality. We evaluated the accuracy of claims data for classifying 
prevalent asthma and chronic obstructive pulmonary disease (COPD) among initiators of LABAs. 

Methods: This study included adult LABA initiators during 2005-2008 in a US commercial health plan. Diagnosis codes 
from the 6 months before LABA initiation identified potential asthma or COPD and a physician adjudicated case status 
using abstracted medical records. We estimated the positive predictive value (PPV) and 95% confidence intervals (CI) of 
covariate patterns for identifying asthma and COPD. 

Results: We sought 520 medical records at random from 225,079 LABA initiators and received 370 (71%). The PPV 
for at least one asthma claim was 74% (CI 63-82), and decreased as age increased. Having at least one COPD claim 
resulted in a PPV of 82% (CI 72-89), and of over 90% among older patients, men, and recipients of inhaled 
anticholinergic drugs. Only 2% (CI 0.2-7.6) of patients with a claim for COPD alone were found to have both COPD 
and asthma, while 9% (CI 4-16) had asthma only. Twenty-one percent (CI 14-30) of patients with claims for both 
diagnoses had both conditions. Among patients with no asthma or COPD claims, 62% (CI 50-72) had no confirmed 
diagnosis and 29% (CI 19-39) had confirmed asthma. 

Conclusions: Subsets of patients with asthma, COPD, and both conditions can be identified and differentiated using 
claims data, although categorization of the remaining patients is infeasible. Safety surveillance for off-label use of LABAs 
must account for this limitation. 
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Background 

Although long-acting ^-agonist (LABA) medications im- 
prove lung function in asthma and chronic obstructive 
pulmonary disease (COPD) by inducing relaxation of 
bronchial smooth muscle and inhibiting release of medi- 
ators of hypersensitivity [1], their use in asthma, at least 
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in the absence of concomitant inhaled corticosteroids 
(ICS), has been associated with more asthma-related 
deaths [2]. These findings, though not uniform [3], have 
led to increased regulatory restrictions on the use of 
LABA, including the implementation of Risk Evaluation 
and Mitigation Strategies (REMS) that aim to inform 
prescribers and patients about these risks [4]. Indeed, 
some LABAs have only an indication for COPD [5]. 

Monitoring whether patients with asthma only use 
LABAs has the potential to ensure that prescribers are 
using the products in accordance with known safety 
data. Physicians should generally avoid prescribing 
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LABA as monotherapy for asthma (an "off-label" use), 
so that unnecessary harms in patients with asthma are 
avoided, while ensuring that the product reaches patients 
with COPD (an "on-label" use), in whom LABA risk- 
benefit profiles appear acceptable. Health insurance claims 
data provide an efficient core for this type of surveillance, 
but the data must accurately characterize LABA users' 
likely indication for use of the drugs (asthma or COPD). 

Indeed, COPD and asthma are distinct clinical entities, 
but share symptoms and treatments. COPD is character- 
ized by non-reversible airflow restriction or obstruction 
due to chronic bronchitis or emphysema [6]. Asthma in- 
volves recurrent airway obstruction, hyper-responsiveness, 
and inflammation [7]. First onset of asthma generally oc- 
curs at a young age, while first onset of COPD typically 
occurs among patients over 40 years of age. 

The similarities in these conditions complicate dif- 
ferentiation of COPD and asthma in claims data. There- 
fore the objective of this study was to identify patterns 
of health insurance claims for asthma and COPD 
among users of LABA (with or without ICS use) that 
might improve the categorization of individual patients 
with asthma or COPD. We studied only new users of 
LABA to quantify the measurement characteristics of 
the data for identifying the indication for treatment so 
that these data would directly inform safety surveillance 
for LABA. 



Methods 

Data sources 

The study population came from the Normative Health 
Information Database, a claims database of a large US 
commercial health plan (UnitedHealth Care). Diagnoses 
associated with the claims are recorded using the Inter- 
national Classification of Disease, 9th revision (ICD-9) 
coding system. Procedures map to ICD-9, Common Pro- 
cedural Terminology (CPT), and the Centers for Medi- 
care and Medicaid Services Common Procedure Coding 
System (HCPCS) codes. National Drug Codes (NDCs) 
identify medications. 

Cohort formation 

Eligible patients were initiators or switchers of LABA or 
LABA and ICS combinations who were at least 20 years 
old between 01 January 2005 and 31 December 2008 
(Figure 1). We included all LABA and ICS products on 
the U.S. market during the study period. The LABAs 
were: arformoterol, formoterol, and salmeterol. The ICS 
were: beclomethasone, budesonide, ciclesonide, fluniso- 
lide, fluticasone, mometasone, and triamcinolone. 

We defined initiation as a dispensing of a LABA pre- 
ceded by 6 months of continuous enrollment without a 
dispensing of the same LABA. Switchers were patients 
who initiated a new LABA, but used another LABA during 
the previous 6 months. The study began for each patient at 



Normative Health Information Database, 
01 January 2005-31 December 2008 



Initiators of LABA with Concomitant ICS 

at least 20 years old 

at least 6 months of continuous health plan 
enrollment without dispensing of same 
LABA 



Initiators of LABA without Concomitant ICS 

at least 20 years old 

at least 6 months of continuous health plan 
enrollment without dispensing of same 
LABA 



Potential Cases of Asthma or COPD 

Claim in 6 months before initiating LABA: 
for asthma (ICD-9 493.xx) 
for COPD {ICD-9 491 .2x, 492.8, 496) 



Random Sample of medical records from: 

-Patients with at least one claim for asthma in the baseline period: 

ICD-9 493.XX, asthma 
-Patients with at least one claim for COPD in the baseline period; 

ICD-9 491. 2x, obstructive chronic bronchitis 

ICD-9 492.8, other emphysema 

ICD-9 496. chronic airway obstruction, not elsewhere classified 
-Patients with claims for both asthma and COPD in the baseline period 
-Patients without a claim for asthma or COPD in the baseline period 



Confirmed 
Asthma 



Confirmed 
COPD 



Confirmed 
Both 



Confirmed 
Neither 



Figure 1 Formation of study cohorts from the Normative Health Information, and Identification and Confirmation of Prevalent Asthma 
and COPD, 1/1/2005-12/31/2008. LABA, identifying long-acting [3-agonist; ICS, inhaled corticosteroid; COPD, chronic obstructive pulmonary 
disease; ICD, International Classification of Diseases. 
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their first eligible LABA dispensing (index date). The 6 
months prior to the index date was the period from which 
we identified diagnosis, procedure, and medication codes 
that characterized the study population. Patients were con- 
sidered concomitant users of LABA and ICS upon initi- 
ation of a combination LABA/ICS product or if they 
initiated a LABA and received a dispensing of an ICS on 
the same day. 

Patients with a recent previous dispensing of an ICS 
were in the monotherapy group. While requiring that 
patients received the combination formulation of LABA/ 
ICS or concomitant ICS on the same day as the initial 
LABA dispensing may result in misclassification of indi- 
viduals who received ICS and LABA on different days, 
this more stringent definition increases the likelihood 
that we include only users concomitant therapy in the 
combination LABA/ICS group. This preference is im- 
portant because combination LABA/ICS for asthma ap- 
pears safer than LABA monotherapy and should not be 
discouraged. (Empirically, this decision was unimportant. 
Ninety-six percent of patients initiated on a combination 
product. Of the 9,965 patients classified as LABA-only 
initiators, 1,931 [19%] used ICS in the baseline period 
and were potentially misclassified. This number repre- 
sents only 0.9% of the full study population, and this 
misclassification is of little consequence). 

Identification of asthma and CORD 

Potential cases of asthma or COPD had ICD-9 diagnosis 
codes for asthma or COPD in any diagnosis field on claims 
occurring in the 6 months prior to the index date on an in- 
patient or outpatient claim (a similar approach requiring 
12 months of continuous enrollment yielded similar re- 
sults). Patients with at least one code for asthma, COPD, 
both, or neither in the baseline period were eligible for sub- 
sequent medical record abstraction. We excluded from 
consideration certain diagnosis codes that might include 
COPD, but are mixed with other disorders, including ICD- 
9 490 (bronchitis, not specified as acute or chronic) [6] . Be- 
cause hospitalization for asthma is rare relative to the 
prevalence of the disease, we did not distinguish between 
inpatient and outpatient claims. We chose to develop our 
own definition of asthma and COPD despite the existence 
of algorithms in the literature (e.g., Mapel et al. [8] and 
Dombkowski et al. [9]), because in our work we aimed to 
classify baseline diagnoses (indications), whereas most defi- 
nitions in the literature apply specifically to outcomes or 
cohort definitions. Definitions of outcomes and covariates 
are more robust to insensitive measures of disease than 
case criteria for identification of off-label use. 

To verify the diagnoses, we sought a random sample 
of 130 medical records (with the goal of obtaining 100) 
from each of the following 4 categories of eligible pa- 
tients (520 patients in total): 



Patients with at least one claim for asthma: 

ICD-9 493.XX, asthma 
Patients with at least one claim for COPD: 

ICD-9 491. 2x, obstructive chronic bronchitis 

ICD-9 492.8, other emphysema 

ICD-9 496, chronic airway obstruction, not elsewhere 

classified 

Patients with claims for both asthma and COPD 
Patients without a claim for either asthma or COPD 

We sought a total of 640 records, including alternate 
records for 120 of the 520 sampled patients. We sought 
medical records from hospitals and physicians' offices 
using a 2-step process. First, we created a chronological 
listing of insurance claims for the sampled patients not- 
ing the date of service corresponding to the diagnosis 
code of interest (asthma or COPD). Patients with claims 
for both diagnoses had the one closest to the LABA ini- 
tiation date noted, and those with neither had no claim 
noted. 

These claims listings were reviewed to identify the pro- 
vider or facility from which the medical record was likely 
to document the diagnosis. Trained abstractors contacted 
the provider or facility seeking the medical record. For 
records with clearly inadequate information (as assessed 
prior to the adjudication process), we re-contacted pro- 
viders to request additional information. If additional 
information was not obtained for these cases, the charts 
were not adjudicated and did not enter analysis. Incom- 
plete medical records were those without clinical informa- 
tion available (i.e., the contained administrative material 
only). Records with clinical information, even if incom- 
plete, were forwarded to the adjudicators for review. 

A physician external to the study team, blinded to study 
medications, adjudicated the presence of asthma and 
COPD using the Global Initiative for Chronic Obstructive 
Lung Disease (GOLD) criteria for COPD [10] and the third 
Expert Panel Report of Guidelines on Asthma [11]. Con- 
firmation required the affirmative listing of the case criteria 
in the medical records. The Additional file 1 includes add- 
itional information on the case adjudication process. 

Analysis 

We initially tabulated characteristics of the study popu- 
lation from the 6 months before LABA initiation, includ- 
ing whether LABA initiators were apparent naive users 
of all LABAs, the prevalence of comorbidities, and the 
intensity of healthcare utilization characteristics, such as 
outpatient visits, emergency department visits, hospita- 
lizations, and home oxygen use. Next, we empirically 
identified covariates by listing the 100 most prevalent 
(top 100) drug classes, top 100 diagnoses (at the 3-digit 
ICD-9 level) and the top 100 procedures received by 
LABA users, stratifying by ICS. 
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Using adjudication results as the gold standard, we 
then estimated the association between the baseline 
characteristics and the adjudicated diagnosis, with the 
aim to distinguish between patients with confirmed 
asthma and those without, and those with confirmed 
COPD and those without. 

We estimated the positive predictive value (PPV) of 
claims identification of asthma or COPD stratified by 
the 3 covariates with the largest absolute difference in 
prevalence across patients with confirmed and uncon- 
firmed asthma. We use this approach among all patients 
except for those with only a claim for COPD. Whereas for 
patients with claims for asthma or no claim for asthma or 
COPD, we were interested in the fraction with asthma 
(and therefore contraindications to LABA therapy), for pa- 
tients with claims-based COPD only, we were interested 
in the fraction with true COPD (i.e., an appropriate indica- 
tion for LABA therapy). For the latter set, we compared 
categories of confirmed COPD vs. unconfirmed COPD to 
identify the 3 most individually discriminating covariates. 
We estimated 95% confidence intervals (CI) using the 
exact binomial method. 

We chose this categorization of asthma and COPD to 
be useful for monitoring off-label prescribing of LABAs, 
where it is of interest to know what fraction of patients 
with claims for COPD truly have COPD (on-label use 
— the latter set), and for patients with at least one 
claim for asthma or for patients with no claim for 
asthma or COPD, what fraction truly have asthma only 
(off-label use — the former set). These analyses were re- 
stricted to patients for whom we received a medical 
record. Additionally, we tabulated these PPVs within 
categories of a number of clinically derived variables 
that could plausibly be associated with a different PPV 
and within covariate patterns defined by the 3 most in- 
dividually discriminating covariates. 

We also conducted a post-hoc regression analysis as an 
additional means to identify covariates whose presence 
may modify the accuracy of the identification of asthma 
or COPD. Using multinomial logistic regression models, 
we regressed confirmed case status (asthma only, COPD 
only, both, or neither, with neither as the referent) on 
the claims definitions for these conditions, plus the co- 
variates with product terms for each covariate and the 
claims definitions. We retained an empirical approach to 
covariate selection by using a stepwise algorithm, enter- 
ing and retaining variables with p-values < 0.05. 

Human subjects considerations 

Since this study used protected health information 
(PHI) to link insurance claims to patient's medical 
records, we operated with the oversight of the New 
England Institutional Review Board who approved our 
protocol, privacy practices, and whose Privacy Board 



granted a waiver of authorization for the use of PHI 
without obtaining patient consent. 

Results 

Of the 225,079 eligible initiators of a LABA, 9,965 (4.4%) 
appeared to receive LABA monotherapy (Table 1). Users 
of a LABA without concomitant ICS were more likely to 
be > 65 years of age, while there were no observed differ- 
ences with respect to sex. Women accounted for nearly 
two-thirds of patients with baseline claims for asthma, 
while men accounted for over one-half of patients with 
COPD. A total of 107,839 of the 225,079 (47.9%) patients 
had no claim for asthma or COPD in the baseline period. 
The distribution of number of diagnoses of asthma or 
COPD in the baseline period was low, ranging from a 
mean of 0.6 in the 0-90 days before the index date to 0.18 
in the 91-183 days before the index date. 

Patients on LABAs without ICS had a higher observed 
prevalence of use of other pulmonary medications, in- 
cluding inhaled anticholinergics, leukotriene modifiers, 
and xanthine derivatives. Use of inhaled anticholinergics 
was more prevalent among patients with baseline claims 
for COPD, while use of leukotriene modifiers was more 
common among patients with claims for asthma. 

We sought 640 medical records related to 520 claims 
consistent with asthma, COPD, both, or neither. One 
hundred twenty of these records were requested from al- 
ternate providers, when such an alternate was available 
and the initial provider was unable or unwilling to 
complete the request. We received medical records relat- 
ing to 370 (71%) of potential cases. The Supplementary 
Material contains information on the reasons for non- 
procurement of medical records, which were generally ad- 
ministrative in nature. Patients whose medical records we 
received were slightly older than the underlying LABA co- 
hort, but had a similar sex distribution (Table 2). 

The PPV of having at least one claim for asthma (and 
no COPD claim) in the 6 months prior to the index date 
was 73.6% (CI 63.3-82.3) for confirmed asthma and 
81.5% for COPD with no asthma claim (CI 72.1-88.9; 
Table 3). We observed that 21.2% (CI 13.8-30.3) of pa- 
tients with claims for asthma and COPD were confirmed 
to have both conditions, while 28.9% of patients with no 
claims for asthma or COPD (CI 19.5-39.9) were con- 
firmed to have asthma. Regarding the negative predictive 
value of claims for asthma and COPD, 61.5% (CI 50.1- 
71.9) of patients without these diagnoses had no evi- 
dence of the conditions in the medical record, while 
28.9% (CI 19.5-39.9) had confirmed asthma and 9.6% 
(CI 4.1-18.1) had confirmed COPD. 

The PPV of having at least one claim for asthma de- 
creased with increasing age, but the PPV of having of at 
least one claim for COPD increased with age (Table 4). 
Stratification on the 3 covariates with the largest individual 



Table 1 Select baseline demographic and clinical characteristics of initiators of long-acting p-agonist and patients with confirmed asthma or COPD status, 
January 1, 2005 - December 31, 2008 

LABA LABA & ICS Asthma COPD Asthma & COPD Neither Asthma nor COPD 
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27.6 


3,357 


39.8 


4,512 


4.2 


Pathology/Laboratory code 


6,724 


67.5 


140,407 


65.3 


58,592 


66.7 


15,357 


734 


6,504 


77.0 


66,678 


61.8 


Spirometry procedure 


3,039 


30.5 


50,465 


23.5 


28,720 


32.7 


7,635 


36.5 


3,912 


46.3 


13,237 


12.3 


Home oxygen use procedure 


783 


7.9 


6,704 


3.1 


1,461 


1.7 


3,402 


16.3 


1,214 


144 


1410 


1.3 


Cardiovascular procedure 


2,936 


29.5 


52,404 


244 


1 9,008 


21.6 


10,399 


49.7 


4,599 


54.5 


21,334 


19.8 


Surgical procedure 


5,283 


53.0 


1 06,468 


49.5 


43,104 


49.1 


13,216 


63.1 


5,334 


63.2 


50,097 


46.5 


Anesthesia procedure 


1,034 


104 


1 7,936 


8.3 


6,887 


7.8 


2,989 


14.3 


1,258 


14.9 


7,836 


7.3 


Visit to allergist/immunologist 


1,111 


11.1 


17,759 


8.3 


14,522 


16.5 


311 


1.5 


689 


8.2 


3,348 


3.1 


Visit to pulmonologist 


2,622 


26.3 


27,141 


12.6 


1 1 ,604 


13.2 


7,856 


37.5 


4,133 


49.0 


6,170 


5.7 



LABA, long-acting beta agonist; ICS, inhaled corticosteroid; COPD, chronic obstructive pulmonary disease. 
^Including the cohort-defining dispensing. 
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Table 2 Baseline age and gender of LABA initiators whose medical record was abstracted for confirmation of asthma 
or COPD, January 1, 2005 - December 31, 2008 

LABA LABA & ICS Asthma COPD Asthma & COPD Neither Asthma nor COPD 

(N = 14) (N = 356) (N = 91) (N = 92) (N = 104) (N = 83) 

N % N % N % N % N % N % 



Age 



20-39 


2 


14.3 


49 


13.8 


24 


264 


4 


44 


6 


5.8 


17 


20.5 


40-64 


11 


78.6 


242 


68.0 


62 


68.1 


58 


63.0 


76 


73.1 


57 


68.7 


>64 


1 


7.1 


65 


18.3 


5 


5.5 


30 


32.6 


22 


212 


9 


10.8 


Women 


8 


57.1 


210 


59.0 


57 


62.6 


50 


54.4 


60 


577 


51 


61.5 



LABA, long-acting beta agonist; ICS, inhaled corticosteroid; COPD, chronic obstructive pulmonary disease. 



discrimination between confirmed and unconfirmed case 
status resulted in higher PPVs. For instance, among patients 
with at least one claim for COPD and at least one dispens- 
ing of an inhaled anticholinergic medication, the PPV was 
94.3% (CI 80.8-99.3). Similar findings were evident for the 
other empirically identified discriminators. 

Stratification on clinically defined covariates resulted 
in some categories where the PPV was higher than the 
average PPV for that diagnosis (Table 5). The PPV for at 
least one asthma claim was increased in the presence of 
previous asthma medication use and lower respiratory 
tract infections. The PPV for at least one COPD claim 
was increased when a pulmonologist was the prescriber 
of the COPD medications and when there was a diagno- 
sis of bronchitis or bronchiolitis. The Supplementary 
Material contains estimated PPVs across strata defined 
by combinations of variables and for a long baseline 
period of 12 months. 

The multinomial logistic regression modeling identi- 
fied several variables that improved prediction of true 
case status through interaction with the claims defini- 
tions. The variables "symptoms involving respiratory sys- 
tem and other chest symptoms" (ICD-9 786.xx), the 
number of baseline drug dispensings, and age > 40 years 
improved prediction of COPD only. The number of drug 
dispensings also improved prediction of asthma only and 
both asthma and COPD relative to neither. The presence 
of a baseline dispensing of a beta-adrenergic drug and 
the diagnosis "other forms of chronic ischemic heart 



disease" (ICD-9 414.xx) improved prediction of true 
asthma only. No other variables arose as significant 
predictors. 

Discussion 

Subsets of LABA initiators with asthma, COPD, and 
both conditions can be identified and differentiated 
using claims data, although categorization of the 
remaining patients is largely infeasible. Within strata of 
selected covariates, the claims showed better predictive 
ability to identify asthma only among patients with 
claims for asthma or claims for both asthma and COPD, 
and to identify COPD among patients with claims for 
COPD. Among patients without claims for asthma or 
COPD, there was no subset within which the PPV 
exceeded 50%, meaning the classification of patients 
who do not have a claim indicating asthma or COPD re- 
mains uncertain. Additionally, requiring the presence of 
claims for asthma or COPD resulted in a population in 
which nearly 25% of persons appear to not have the con- 
dition of interest. 

That a substantial fraction of the LABA users did not 
have a claim associated with asthma or COPD is prob- 
lematic in that it leaves a large fraction of patients un- 
classified in the data. Similarly, multiple diagnoses of 
asthma or COPD were rare, limiting our ability to refine 
the algorithms by requiring more than one diagnosis for 
the condition of interest. Both of these findings are con- 
sistent with previous experience with health plan data. 



Table 3 Confirmed cases of asthma, chronic obstructive pulmonary disease, both, or neither among the corresponding 
claims categories 

Confirmed cases 



Claims-identified cases 



Asthma 



COPD 



Asthma and COPD 



Unconfirmed 





N 


% 


N 


% 


N 


% 


N 


% 


Asthma {n = 91) 


67 


73.6 


2 


2.2 


0 


0.0 


22 


24.2 


COPD (n = 92) 


6 


8.7 


73 


81.5 


2 


2.2 


11 


7.6 


Both {n = 104) 


40 


38.5 


35 


33.7 


22 


21.2 


7 


6.7 


Neither (n = 83) 


24 


28.9 


8 


9.6 


0 


0.0 


51 


61.5 



COPD, Chronic Obstructive Pulmonary Disease. 
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Table 4 Positive predictive value of claims for asthma, COPD, Both or Neither in the 6 Months prior to initiation of a 
long-acting beta agonist. Overall and stratified by empirically-Identified covariates 

Number of Medical records Positive predictive 95% CI (%) 

confirmed cases received value (%) 



Claim for asthma only 

Overall 
Age, years 

20-39 

40-64 

> 64 
Sex 

Male 
Female 

Top 3 Variables predictive of asthma 
confirmation 

Outpatient visit, moderate complexity 
Beta-adrenergic drug dispensing 
West region 

Claim for COPD only 

Overall 
Age, years 

20-39 

40-64 

> 64 
Sex 

Male 
Female 

Top 3 Variables predictive of COPD confirmation 

6S+ years of age 

hhaled anticholinergic drug dispensing 



Radiologic examination, chest, 2 views, 
frontal and lateral 



Claim for Asthma and COPD (PPV of asthma only) 

Overall 
Age, years 

20-39 

40-64 

> 64 
Sex 

Male 

Female 



Yes 
No 
Yes 
No 
Yes 
No 



Yes 
No 
Yes 
No 
Yes 

No 



67 

19 
45 
3 

25 
42 



42 
25 
53 
14 
18 
49 

75 

2 

44 
29 

38 
37 

29 
45 
33 
42 



27 
40 
5 

30 
5 

19 
21 



91 

24 
62 
5 

34 
57 



51 
40 
66 
25 
19 
72 

92 

4 

58 

30 

42 
50 

30 
62 
35 
57 
54 

38 

104 

6 

76 

22 

44 
60 



73.6 

792 
72.6 
60.0 

73.5 
73.7 



824 
62.5 
80.3 
56.0 
94.7 
68.1 



50.0 
75.9 
96.7 

90.5 
74.0 

96.7 
74.2 
94.3 
73.7 



71.1 

38.5 

83.3 
39.5 
22.7 

43.2 
35.0 



63.3, 82.3 

57.8, 92.9 
59.8, 83.1 
14.7, 94.7 

55.6, 87.1 
60.3, 84.5 



69.1, 91.6 

45.8, 77.3 

68.7, 89.1 

34.9, 75.6 
74.0, 99.9 

56.0, 78.6 

72.1, 88.9 

6.8, 93.2 

62.8, 861 
82.8, 99.9 

77.4, 97.3 

59.7, 864 

82.8, 99.9 

61.5, 84.5 

80.8, 99.3 

60.3, 84.5 

77.4, 95.8 

54.1, 84.6 
29.1,48.5 

35.9, 99.6 
28.4, 52.4 
7.8, 454 

28.3, 59.0 
23.1,484 
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Table 4 Positive predictive value of claims for asthma, COPD, Both or Neither in the 6 Months prior to initiation of a 
long-acting beta agonist. Overall and stratified by empirically-identified covariates (Continued) 

Top 3 Variables predictive of asthma only among 
patients with claims-based COPD and asthma 

Chronic airway obstruction, not elsewiiere 
classified (ICD-9 496.xx) 



General Bronchodilator Agents 
nhaled corticosteroid dispensing 

Wo claims for asthma or COPD (PPV of asthma only) 

Overall 
Age, years 

20-39 

40-64 

> 64 
Sex 

Male 

Female 

Top 3 Variables predictive of asthma only among 
patients with neither claims-based COPD nor asthma 

Lipid panel 

Collection of venous blood by venipuncture 



Yes 

No 
Yes 
No 
Yes 
No 



Macrolides 



COPD, chronic obstructive pulmonary disease. 



Yes 
No 
Yes 
No 
Yes 
No 



20 

20 
6 

34 

9 

31 

24 

7 

14 

3 



16 



23 

4 

20 

4 

20 



Loughlin and colleagues found with tegaserod, a drug 
with a clear indication (irritable bowel syndrome), only 
32% of tegaserod initiators had a claim for irritable 
bowel syndrome in the 6-month period preceding tega- 
serod initiation [12]. To address this expected feature of 
the data, we abstracted medical records on a subset of 
LABA initiators with no claims for asthma or COPD, and 
confirmed their actual case status. The resulting data pro- 
vide an estimate of the distribution of actual asthma and 
COPD among those without a claims-diagnosis. Neverthe- 
less, a large fraction of patients remain unclassified. In 
studies of off-label use, this limitation means that there 
will be overestimation of off-label use (under the assump- 
tion that some of the unclassified patients have the 
"on-label" indication). In studies where there is a desire 
to exclude patients with asthma or COPD, it may be 
infeasible to completely exclude these individuals. 

Our findings were qualitatively similar to those in a 
study of the predictive ability of the Lovelace Health 
Plan data, a staff- and network-model health mainten- 
ance organization, for identifying preclinical COPD [8]. 



76 

28 
35 
69 
39 
65 

83 

17 
57 
9 

32 
51 



23 
60 

31 
52 
29 

54 



26.3 

714 
17.1 
49.3 
23.1 
47.7 

28.9 

41.2 
24.6 
33.3 

25.0 
314 



44 

38.3 
12.9 
38.5 
13.8 
37.0 



16.9, 37.7 

51.3, 86.8 
6.6, 33.6 

37.0, 61.6 

11.1, 39.3 
35.1, 60.5 

19.5, 39.9 

18.4, 67.1 
141, 37.8 
75, 70.1 

1 1 .5, 434 
19.1,45.9 



0.1, 21.9 
261, 51.8 
3.6, 29.8 
25.3, 53.0 
3.9, 317 
24.3, 51.3 



In that study, a small number of claims-based variables 
predicted the presence of preclinical COPD with a PPV 
of 23% to 39% depending on the definition used. The 
higher PPVs observed in our study probably reflect our 
focus on diagnosed COPD, while the Lovelace study 
screened for preclinical disease. 

We did not directly assess the sensitivity of the claims 
definition; however, the small number of LABA users 
observed to have baseline claims for asthma or COPD 
overall suggest that the sensitivity of the diagnosis codes 
on claims may be low since nearly all LABA users would 
be expected to have one of these conditions. Other limi- 
tations of this study include the use of medical records 
as a gold standard measure of asthma and COPD. This 
approach requires the assumption that the information 
needed for asthma and COPD classification is present 
and not differentially present across the strata of the pre- 
dictive variables. If the incorrect diagnosis is listed in the 
medical record or the medical record is incomplete, then 
the present estimates of the PPV could be biased. The 
bias would likely result in an underestimate of the PPV 
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Table 5 Positive predictive value of claims for asthma, COPD, both or neither in the 6 months prior to initiation of a 
long-acting beta agonist, overall and stratified by clinically-defined covariates 

Number of Medical records Positive predictive 95% CI (%) 

confirmed cases received value (%) 

Claim for asthma only 

Medications 

Previous LABA 7 8 87.5 47.3, 99.7 

Previous ICS 12 14 85.7 57.2, 98.2 

Inhaled anticholinergics 0 0 0.0 N/A 

Systemic corticosteroids 31 40 77.5 61.5,89.2 

Leukotriene modifiers 24 30 80.0 61.4,92.3 

Xanthine inhibitors 3 3 100.0 29.2,100.0 
Prescriber Specialty 

Family/general provider 36 48 75.0 60.4, 864 

Allergy/immunology 15 20 75.0 51.0,91.3 

Internal medicine 30 42 714 55.4,84.3 

Pulmonology 13 17 76.5 50.1,93.2 
Diagnoses 

Upper respiratory tract infections 40 49 81.6 68.0,91.2 

Lower respiratory tract infection 67 91 73.6 63.3, 82.3 

Bronchitis/Bronciolitis 19 24 79.2 57.8, 93.0 

Spirometry procedure 25 33 78.8 61.1,91.0 

Claim for COPD Only 

Medications 

Previous LABA 3 5 60.0 14.7, 94.7 

Previous ICS 4 4 100.0 39.8,100.0 

Inhaled anticholinergics 33 35 94.3 80.8, 99.3 

Systemic corticosteroids 29 36 80.6 64.0,91.8 

Leukotriene modifiers 5 9 55.6 21.2,86.3 

Xanthine inhibitors 2 2 100.0 16.8,100.0 
Prescriber Specialty 

Family/general provider 40 48 83.3 69.8, 92.5 

Allergy/immunology 0 3 0.0 0.0, 70.6 

Internal medicine 34 42 81.0 65.9,914 

Pulmonology 29 32 90.6 75.0, 98.0 
Diagnoses 

Upper respiratory tract infections 12 20 60.0 36.1,80.9 

Lower respiratory tract infection 75 92 81.5 72.1,88.9 

Bronchitis/Bronciolitis 51 59 864 75.0, 94.0 

Spirometry procedure 32 39 82.1 66.5, 92.5 

Claim for asthma and COPD (PPV of asthma only) 

Medications 

Previous LABA 3 12 25.0 5.5,572 

Previous ICS 4 14 28.6 8.4, 58.1 

Inhaled anticholinergics 9 39 23.1 11.1,39.3 

Systemic corticosteroids 27 70 38.6 27.1,51.0 

Leukotriene modifiers 10 30 33.3 17.3,52.8 
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Table 5 Positive predictive value of claims for asthma, COPD, both or neither in the 6 months prior to initiation of a 
long-acting beta agonist, overall and stratified by clinically-defined covariates (Continued) 



Xanthine inliibitors 


2 


6 


33.3 


4.3, 77.7 


Prescriber Specialty 










Family/general provider 


22 


67 


32.8 


21.8, 454 


Allergy/immunology 


7 


10 


70.0 


34.8, 93.3 


Internal medicine 


25 


59 


424 


29.6, 55.9 


Pulmonology 


19 


52 


36.5 


23.6, 51.0 


Diagnoses 










Upper respiratory tract infections 


20 


43 


46.5 


31.2, 62.3 


Lower respiratory tract infection 


40 


104 


385 


29.1,485 


Bronchitis/Bronciolitis 


28 


72 


38.9 


27.6, 51.1 


Spirometry procedure 


21 


53 


39.6 


25.5, 54.0 


Wo claims for asthma or COPD (PPV of asthma only) 










Medications 










Previous LABA 


0 


4 


0.0 


0.0, 60.2 


Previous ICS 


0 


2 


0.0 


0.0, 84.2 


Inhaled anticholinergics 


0 


2 


0.0 


0.0, 84.2 


Systemic corticosteroids 


9 


28 


32.1 


15.9, 524 


Leukotriene modifiers 


5 


11 


455 


16.7, 76.6 


Xanthine inhibitors 


0 


0 


0.0 


N/A 


Prescriber specialty 










Family/general provider 


12 


48 


25.0 


1 3.6, 39.6 


Allergy/immunology 


1 


1 


100.0 


25, 100.0 


Internal medicine 


7 


28 


25.0 


10.7,44.9 


Pulmonology 


3 


7 


42.9 


9.9, 81.6 


Diagnoses 










Upper respiratory tract infections 


5 


30 


16.7 


5.6, 34.7 


Lower respiratory tract infection 


6 


33 


18.2 


7.0, 35.5 


Bronchitis/Bronchiolitis 


5 


29 


17.2 


5.8, 35.8 


Spirometry procedure 


3 


8 


375 


85, 755 



if the medical records are incomplete, since we required 
that cases have the diagnostic criteria affirmatively listed 
in their record. 

These data may not be generalizable to populations of 
patients who do not use LABAs and caution is warranted 
for applications of these data to patients with different 
treatment patterns. Since our objective was to study LABA 
initiators, we did not collected data on non-users of 
LABA. Similarly, these data may not generalize to popula- 
tions other than the commercially insured, but stratifying 
this population according to relevant characteristics and 
providing the PPV within strata, improves the external 
application of these data for case identification [13]. Al- 
though these characteristics for stratification are based on 
health insurance claims in this study were, and so are sub- 
ject to misclassification on the clinical constructs of inter- 
est, this type of misclassification is frequently thought to 



be non-differential with respect to other claims-based var- 
iables so that the most plausible direction of misclassifica- 
tion bias would be toward showing no difference in the 
PPV across these variables [14]. In some strata of predict- 
ive covariates, the data were sparse, which resulted in un- 
certainty around some PPV estimates. Additionally, we 
evaluated the performance of our own measure of asthma 
and COPD. Therefore, these data may provide limited in- 
formation on the validity of other disease definitions. 

A major strength of this study is the large source popu- 
lation, and its reflection of routine clinical practice across 
the US. These data provide adequate statistical power for 
the study across a number of stratification variables, and 
improves its generalizabUity. 

Because of low sensitivity, the claims data do not seem 
sufficient to definitively identify asthma alone without sac- 
rificing the PPV. However, this study provides estimates of 
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the fraction of patients with confirmed asthma that one 
might expect from studies identified on the basis of claims 
alone. For subsets of patients with claims for asthma or 
COPD, the claims have fairly high predictive ability for 
identifying actual diagnoses. Therefore, a reasonable use 
of these data for LABA risk management is to estimate 
the fraction of patients with asthma through application of 
the observed distributions from this study, and to identify 
subsets of these patients based on the presence of at least 
one additional predictive covariate to achieve a higher de- 
gree of specificity. This use of the data would allow for 
periodic tracking of the fraction of potential off-label use 
among a subset of patients likely to have asthma only, 
while at the same time applying the observed (confirmed) 
distribution of asthma only from this study for broader 
context. 

Conclusions 

In summary, the results from this study suggest that it is 
feasible to differentiate subsets of LABA initiators into 
categories that might represent on- vs. off-label use of 
LABAs. It is not possible to categorize all LABA initia- 
tors with respect to these diagnoses. Safety surveillance 
for off-label use of LABAs must account for this limita- 
tion. Nevertheless, these data provide confirmed distri- 
butions of actual diagnoses that can be extrapolated to 
future surveillance studies and facilitate improved identi- 
fication of subsets of patients with asthma, COPD, both, 
or neither on the basis of health insurance claims data. 
Implementation of simple algorithms that combine the 
presence of a diagnosis code for asthma or COPD with 
the presence or absence of a number of single PPV- 
predictive covariates would allow for periodic tracking of 
off-label LABA prescribing among subsets of all LABA 
users. The specific algorithm chosen should be targeted 
to the application at hand. 

Additional file 



Additional file 1: Identification of Prevalent Asthma and Chronic 
Obstructive Pulmonary Disease among Initiators of Long-Acting 
P-Agonists in Health Insurance Claims Data. 
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